Explainable artificial intelligence approach towards classifying educational android app reviews using deep learning

Mobile application developers rely largely on user reviews for identifying issues in mobile applications and meeting the users' expectations. User reviews are unstructured, unorganized and very informal. Identifying and classifying issues by extracting required information from reviews is difficult due to a large number of reviews. To automate the process of classifying reviews many researchers have adopted machine learning approaches. Keeping in view, the rising demand for educational applications, especially during COVID-19, this research aims to automate Android application education reviews' classification and sentiment analysis using natural language processing and machine learning techniques. A baseline corpus comprising 13,000 records has been built by collecting reviews of more than 20 educational applications. The reviews were then manually labelled with respect to sentiment and issue types mentioned in each review. User reviews are classified into eight categories and various machine learning algorithms are applied to classify users' sentiments and issues of applications. The results demonstrate that our proposed framework achieved an accuracy of 97% for sentiment identification and an accuracy of 94% in classifying the most significant issues. Moreover, the interpretability of the model is verified by using the explainable artificial intelligence technique of local interpretable model-agnostic explanations. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

Interpretable tourism demand forecasting with temporal fusion transformers amid COVID-19.

An innovative ADE-TFT interpretable tourism demand forecasting model was proposed to address the issue of the insufficient interpretability of existing tourism demand forecasting. This model effectively optimizes the parameters of the Temporal Fusion Transformer (TFT) using an adaptive differential evolution algorithm (ADE). TFT is a brand-new attention-based deep learning model that excels in prediction research by fusing high-performance prediction with time-dynamic interpretable analysis. The TFT model can produce explicable predictions of tourism demand, including attention analysis of time steps and the ranking of input factors' relevance. While doing so, this study adds something unique to the literature on tourism by using historical tourism volume, monthly new confirmed cases of travel destinations, and big data from travel forums and search engines to increase the precision of forecasting tourist volume during the COVID-19 pandemic. The mood of travelers and the many subjects they spoke about throughout off-season and peak travel periods were examined using a convolutional neural network model. In addition, a novel technique for choosing keywords from Google Trends was suggested. In other words, the Latent Dirichlet Allocation topic model was used to categorize the major travel-related subjects of forum postings, after which the most relevant search terms for each topic were determined. According to the findings, it is possible to estimate tourism demand during the COVID-19 pandemic by combining quantitative and emotion-based characteristics.

Ensemble Learning for Interpretable Concept Drift and Its Application to Drug Recommendation

During the COVID-19 epidemic, the online prescription pattern of Internet healthcare pro-vides guarantee for the patients with chronic diseases and reduces the risk of cross-infection, but it also raises the burden of decision-making for doctors. Online drug recommendation system can effectively assist doctors by analysing the electronic medical records (EMR) of patients. Unlike commercial recommendations, the accuracy of drug recommendations should be very high due to their relevance to patient health. Besides, concept drift may occur in the drug treatment data streams, handling drift and location drift causes is critical to the accuracy and reliability of the rec-ommended results. This paper proposes a multi-model fusion online drug recommendation system based on the association of drug and pathological features with online-nearline-offline architecture.The system transforms drug recommendation into pattern classification and adopts interpretable concept drift detection and adaptive ensemble classification algorithms. We apply the system to the Percutaneous Coronary Intervention (PCI) treatment process. The experiment results show our system performs nearly as good as doctors, the accuracy is close to 100%.

Evaluation of Synthetic Categorical Data Generation Techniques for Predicting Cardiovascular Diseases and Post-Hoc Interpretability of the Risk Factors

Machine Learning (ML) methods have become important for enhancing the performance of decision-support predictive models. However, class imbalance is one of the main challenges for developing ML models, because it may bias the learning process and the model generalization ability. In this paper, we consider oversampling methods for generating synthetic categorical clinical data aiming to improve the predictive performance in ML models, and the identification of risk factors for cardiovascular diseases (CVDs). We performed a comparative study of several categorical synthetic data generation methods, including Synthetic Minority Oversampling Technique Nominal (SMOTEN), Tabular Variational Autoencoder (TVAE) and Conditional Tabular Generative Adversarial Networks (CTGANs). Then, we assessed the impact of combining oversampling strategies and linear and nonlinear supervised ML methods. Lastly, we conducted a post-hoc model interpretability based on the importance of the risk factors. Experimental results show the potential of GAN-based models for generating high-quality categorical synthetic data, yielding probability mass functions that are very close to those provided by real data, maintaining relevant insights, and contributing to increasing the predictive performance. The GAN-based model and a linear classifier outperform other oversampling techniques, improving the area under the curve by 2%. These results demonstrate the capability of synthetic data to help with both determining risk factors and building models for CVD prediction.

Forecasting patient flows with pandemic induced concept drift using explainable machine learning.

Accurately forecasting patient arrivals at Urgent Care Clinics (UCCs) and Emergency Departments (EDs) is important for effective resourcing and patient care. However, correctly estimating patient flows is not straightforward since it depends on many drivers. The predictability of patient arrivals has recently been further complicated by the COVID-19 pandemic conditions and the resulting lockdowns. This study investigates how a suite of novel quasi-real-time variables like Google search terms, pedestrian traffic, the prevailing incidence levels of influenza, as well as the COVID-19 Alert Level indicators can both generally improve the forecasting models of patient flows and effectively adapt the models to the unfolding disruptions of pandemic conditions. This research also uniquely contributes to the body of work in this domain by employing tools from the eXplainable AI field to investigate more deeply the internal mechanics of the models than has previously been done. The Voting ensemble-based method combining machine learning and statistical techniques was the most reliable in our experiments. Our study showed that the prevailing COVID-19 Alert Level feature together with Google search terms and pedestrian traffic were effective at producing generalisable forecasts. The implications of this study are that proxy variables can effectively augment standard autoregressive features to ensure accurate forecasting of patient flows. The experiments showed that the proposed features are potentially effective model inputs for preserving forecast accuracies in the event of future pandemic outbreaks.

AI-based radiodiagnosis using chest X-rays: A review.

Chest Radiograph or Chest X-ray (CXR) is a common, fast, non-invasive, relatively cheap radiological examination method in medical sciences. CXRs can aid in diagnosing many lung ailments such as Pneumonia, Tuberculosis, Pneumoconiosis, COVID-19, and lung cancer. Apart from other radiological examinations, every year, 2 billion CXRs are performed worldwide. However, the availability of the workforce to handle this amount of workload in hospitals is cumbersome, particularly in developing and low-income nations. Recent advances in AI, particularly in computer vision, have drawn attention to solving challenging medical image analysis problems. Healthcare is one of the areas where AI/ML-based assistive screening/diagnostic aid can play a crucial part in social welfare. However, it faces multiple challenges, such as small sample space, data privacy, poor quality samples, adversarial attacks and most importantly, the model interpretability for reliability on machine intelligence. This paper provides a structured review of the CXR-based analysis for different tasks, lung diseases and, in particular, the challenges faced by AI/ML-based systems for diagnosis. Further, we provide an overview of existing datasets, evaluation metrics for different[][15mm][0mm]Q5 tasks and patents issued. We also present key challenges and open problems in this research domain.

Explainable Deep Learning for Medical Imaging Models Through Class Specific Semantic Dictionaries

Explainability is important in the design and deployment of neural networks. It allows engineers to design better models and can give end-users an improved understanding of the outputs. However, many explainability methods are unsuited to the domain of medical imaging. Saliency mapping methods only describe what regions of an input image contributed to the output, but don't explain the important visual features within those regions. Feature visualization methods have not yet been useful in the domain of medical imaging due to the visual complexity of images generally resulting in un-interpretable features. In this work, we propose a novel explainability technique called 'Class Specific Semantic Dictionaries'. This extends saliency mapping and feature visualisation methods to enable the analysis of neural network decision-making in the context of medical image diagnosis. By utilising gradient information from the fully connected layers, our approach is able to give insight into the channels deemed important by the network for the diagnosis of each particular disease. The important channels for a class are contextualised by showing the highly activating examples from the training data, providing an understanding of the learned features through example. The explainability techniques are combined into a single User Interface (UI) to streamline the evaluation of neural networks. To demonstrate how our new method overcomes the explainability challenges of medical imaging models we analyse COVID-Net, an open source convolutional neural network for diagnosing COVID-19 from chest x-rays. We present evidence that, despite achieving 96.3% accuracy on the test data, COVID-Net uses confounding variables not indicative of underlying disease to discriminate between COVID-Positive and COVID-Negative patients and may not generalise well on new data. © 2022 IEEE.

Automated Monitoring of Adherence to Evidenced-Based Clinical Guideline Recommendations: Design and Implementation Study.

BACKGROUND: Clinical practice guidelines are systematically developed statements intended to optimize patient care. However, a gapless implementation of guideline recommendations requires health care personnel not only to be aware of the recommendations and to support their content but also to recognize every situation in which they are applicable. To not miss situations in which recommendations should be applied, computerized clinical decision support can be provided through a system that allows an automated monitoring of adherence to clinical guideline recommendations in individual patients. OBJECTIVE: This study aims to collect and analyze the requirements for a system that allows the monitoring of adherence to evidence-based clinical guideline recommendations in individual patients and, based on these requirements, to design and implement a software prototype that integrates guideline recommendations with individual patient data, and to demonstrate the prototype's utility in treatment recommendations. METHODS: We performed a work process analysis with experienced intensive care clinicians to develop a conceptual model of how to support guideline adherence monitoring in clinical routine and identified which steps in the model could be supported electronically. We then identified the core requirements of a software system to support recommendation adherence monitoring in a consensus-based requirements analysis within the loosely structured focus group work of key stakeholders (clinicians, guideline developers, health data engineers, and software developers). On the basis of these requirements, we designed and implemented a modular system architecture. To demonstrate its utility, we applied the prototype to monitor adherence to a COVID-19 treatment recommendation using clinical data from a large European university hospital. RESULTS: We designed a system that integrates guideline recommendations with real-time clinical data to evaluate individual guideline recommendation adherence and developed a functional prototype. The needs analysis with clinical staff resulted in a flowchart describing the work process of how adherence to recommendations should be monitored. Four core requirements were identified: the ability to decide whether a recommendation is applicable and implemented for a specific patient, the ability to integrate clinical data from different data formats and data structures, the ability to display raw patient data, and the use of a Fast Healthcare Interoperability Resources-based format for the representation of clinical practice guidelines to provide an interoperable, standards-based guideline recommendation exchange format. CONCLUSIONS: Our system has advantages in terms of individual patient treatment and quality management in hospitals. However, further studies are needed to measure its impact on patient outcomes and evaluate its resource effectiveness in different clinical settings. We specified a modular software architecture that allows experts from different fields to work independently and focus on their area of expertise. We have released the source code of our system under an open-source license and invite for collaborative further development of the system.

Deep Learning Algorithms with LIME and Similarity Distance Analysis on COVID-19 Chest X-ray Dataset.

In the last few years, many types of research have been conducted on the most harmful pandemic, COVID-19. Machine learning approaches have been applied to investigate chest X-rays of COVID-19 patients in many respects. This study focuses on the deep learning algorithm from the standpoint of feature space and similarity analysis. Firstly, we utilized Local Interpretable Model-agnostic Explanations (LIME) to justify the necessity of the region of interest (ROI) process and further prepared ROI via U-Net segmentation that masked out non-lung areas of images to prevent the classifier from being distracted by irrelevant features. The experimental results were promising, with detection performance reaching an overall accuracy of 95.5%, a sensitivity of 98.4%, a precision of 94.7%, and an F1 score of 96.5% on the COVID-19 category. Secondly, we applied similarity analysis to identify outliers and further provided an objective confidence reference specific to the similarity distance to centers or boundaries of clusters while inferring. Finally, the experimental results suggested putting more effort into enhancing the low-accuracy subspace locally, which is identified by the similarity distance to the centers. The experimental results were promising, and based on those perspectives, our approach could be more flexible to deploy dedicated classifiers specific to different subspaces instead of one rigid end-to-end black box model for all feature space.

Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks.

Artificial Intelligence (AI) techniques of deep learning have revolutionized the disease diagnosis with their outstanding image classification performance. In spite of the outstanding results, the widespread adoption of these techniques in clinical practice is still taking place at a moderate pace. One of the major hindrance is that a trained Deep Neural Networks (DNN) model provides a prediction, but questions about why and how that prediction was made remain unanswered. This linkage is of utmost importance for the regulated healthcare domain to increase the trust in the automated diagnosis system by the practitioners, patients and other stakeholders. The application of deep learning for medical imaging has to be interpreted with caution due to the health and safety concerns similar to blame attribution in the case of an accident involving autonomous cars. The consequences of both a false positive and false negative cases are far reaching for patients' welfare and cannot be ignored. This is exacerbated by the fact that the state-of-the-art deep learning algorithms comprise of complex interconnected structures, millions of parameters, and a 'black box' nature, offering little understanding of their inner working unlike the traditional machine learning algorithms. Explainable AI (XAI) techniques help to understand model predictions which help develop trust in the system, accelerate the disease diagnosis, and meet adherence to regulatory requirements. This survey provides a comprehensive review of the promising field of XAI for biomedical imaging diagnostics. We also provide a categorization of the XAI techniques, discuss the open challenges, and provide future directions for XAI which would be of interest to clinicians, regulators and model developers.

Interpretable tourism volume forecasting with multivariate time series under the impact of COVID-19.

This study proposes a novel interpretable framework to forecast the daily tourism volume of Jiuzhaigou Valley, Huangshan Mountain, and Siguniang Mountain in China under the impact of COVID-19 by using multivariate time-series data, particularly historical tourism volume data, COVID-19 data, the Baidu index, and weather data. For the first time, epidemic-related search engine data is introduced for tourism demand forecasting. A new method named the composition leading search index-variational mode decomposition is proposed to process search engine data. Meanwhile, to overcome the problem of insufficient interpretability of existing tourism demand forecasting, a new model of DE-TFT interpretable tourism demand forecasting is proposed in this study, in which the hyperparameters of temporal fusion transformers (TFT) are optimized intelligently and efficiently based on the differential evolution algorithm. TFT is an attention-based deep learning model that combines high-performance forecasting with interpretable analysis of temporal dynamics, displaying excellent performance in forecasting research. The TFT model produces an interpretable tourism demand forecast output, including the importance ranking of different input variables and attention analysis at different time steps. Besides, the validity of the proposed forecasting framework is verified based on three cases. Interpretable experimental results show that the epidemic-related search engine data can well reflect the concerns of tourists about tourism during the COVID-19 epidemic.

Application of machine learning techniques for predicting survival in ovarian cancer.

BACKGROUND: Ovarian cancer is the fifth leading cause of mortality among women in the United States. Ovarian cancer is also known as forgotten cancer or silent disease. The survival of ovarian cancer patients depends on several factors, including the treatment process and the prognosis. METHODS: The ovarian cancer patients' dataset is compiled from the Surveillance, Epidemiology, and End Results (SEER) database. With the help of a clinician, the dataset is curated, and the most relevant features are selected. Pearson's second coefficient of skewness test is used to evaluate the skewness of the dataset. Pearson correlation coefficient is also used to investigate the associations between features. Statistical test is utilized to evaluate the significance of the features. Six Machine Learning (ML) models, including K-Nearest Neighbors , Support Vector Machine (SVM), Decision Tree (DT), Random Forest (RF), Adaptive Boosting (AdaBoost), and Extreme Gradient Boosting (XGBoost), are implemented for survival prediction in both classification and regression approaches. An interpretable method, Shapley Additive Explanations (SHAP), is applied to clarify the decision-making process and determine the importance of each feature in prediction. Additionally, DTs of the RF model are displayed to show how the model predicts the survival intervals. RESULTS: Our results show that RF (Accuracy = 88.72%, AUC = 82.38%) and XGBoost (Root Mean Squad Error (RMSE)) = 20.61%, R2 = 0.4667) have the best performance for classification and regression approaches, respectively. Furthermore, using the SHAP method along with extracted DTs of the RF model, the most important features in the dataset are identified. Histologic type ICD-O-3, chemotherapy recode, year of diagnosis, age at diagnosis, tumor stage, and grade are the most important determinant factors in survival prediction. CONCLUSION: To the best of our knowledge, our study is the first study that develops various ML models to predict ovarian cancer patients' survival on the SEER database in both classification and regression approaches. These ML algorithms also achieve more accurate results and outperform statistical methods. Furthermore, our study is the first study to use the SHAP method to increase confidence and transparency of the proposed models' prediction for clinicians. Moreover, our developed models, as an automated auxiliary tool, can help clinicians to have a better understanding of the estimated survival as well as important features that affect survival.

BrainActivity1: A Framework of EEG Data Collection and Machine Learning Analysis for College Students

Using Machine Learning and Deep Learning to predict cognitive tasks from electroencephalography (EEG) signals has been a fast-developing area in Brain-Computer Interfaces (BCI). However, during the COVID-19 pandemic, data collection and analysis could be more challenging than before. This paper explored machine learning algorithms that can run efficiently on personal computers for BCI classification tasks. Also, we investigated a way to conduct such BCI experiments remotely via Zoom. The results showed that Random Forest and RBF SVM performed well for EEG classification tasks. The remote experiment during the pandemic yielded several challenges, and we discussed the possible solutions;nevertheless, we developed a protocol that grants non-experts who are interested a guideline for such data collection. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

EventScore: An Automated Real-time Early Warning Score for Clinical Events

Early prediction of patients at risk of clinical deterioration can help physicians intervene and alter their clinical course towards better outcomes. In addition to the accuracy requirement, early warning systems must make the predictions early enough to give physicians enough time to intervene. Interpretability is also one of the challenges when building such systems since being able to justify the reasoning behind model decisions is desirable in clinical practice. In this work, we built an interpretable model for the early prediction of various adverse clinical events indicative of clinical deterioration. The model is evaluated on two datasets and four clinical events. The first dataset is collected in a predominantly COVID-19 positive population at Stony Brook Hospital. The second dataset is the MIMIC III dataset. The model was trained to provide early warning scores for ventilation, ICU transfer, and mortality prediction tasks on the Stony Brook Hospital dataset and to predict mortality and the need for vasopressors on the MIMIC III dataset. Our model first separates each feature into multiple ranges and then uses logistic regression with lasso penalization to select the subset of ranges for each feature. The model training is completely automated and doesn't require expert knowledge like other early warning scores. We compare our model to the Modified Early Warning Score (MEWS) and quick SOFA (qSOFA), commonly used in hospitals. We show that our model outperforms these models in the area under the receiver operating characteristic curve (AUROC) while having a similar or better median detection time on all clinical events, even when using fewer features. Unlike MEWS and qSOFA, our model can be entirely automated without requiring any manually recorded features. We also show that discretization improves model performance by comparing our model to a baseline logistic regression model. © 2022 IEEE.

Fusing XGBoost and SHAP Models for Maritime Accident Prediction and Causality Interpretability Analysis

In order to prevent safety risks, control marine accidents and improve the overall safety of marine navigation, this study established a marine accident prediction model. The influences of management characteristics, environmental characteristics, personnel characteristics, ship characteristics, pilotage characteristics, wharf characteristics and other factors on the safety risk of maritime navigation are discussed. Based on the official data of Zhejiang Maritime Bureau, the extreme gradient boosting (XGBoost) algorithm was used to construct a maritime accident classification prediction model, and the explainable machine learning framework SHAP was used to analyze the causal factors of accident risk and the contribution of each feature to the occurrence of maritime accidents. The results show that the XGBoost algorithm can accurately predict the accident types of maritime accidents with an accuracy, precision and recall rate of 97.14%. The crew factor is an important factor affecting the safety risk of maritime navigation, whereas maintaining the equipment and facilities in good condition and improving the management level of shipping companies have positive effects on improving maritime safety. By explaining the correlation between maritime accident characteristics and maritime accidents, this study can provide scientific guidance for maritime management departments and ship companies regarding the control or management of maritime accident prevention.

Interpretable AI for policy-making in pandemics

Since the first wave of the COVID-19 pandemic, governments have applied restrictions in order to slow down its spreading. However, creating such policies is hard, especially because the government needs to trade-off the spreading of the pandemic with the economic losses. For this reason, several works have applied machine learning techniques, often with the help of special-purpose simulators, to generate policies that were more effective than the ones obtained by governments. While the performance of such approaches are promising, they suffer from a fundamental issue: since such approaches are based on black-box machine learning, their real-world applicability is limited, because these policies cannot be analyzed, nor tested, and thus they are not trustable. In this work, we employ a recently developed hybrid approach, which combines reinforcement learning with evolutionary computation, for the generation of interpretable policies for containing the pandemic. These policies, trained on an existing simulator, aim to reduce the spreading of the pandemic while minimizing the economic losses. Our results show that our approach is able to find solutions that are extremely simple, yet very powerful. In fact, our approach has significantly better performance (in simulated scenarios) than both previous work and government policies. © 2022 ACM.

The application of interpretable machine learning model based on comparative learning and NARMAX in epidemic research

Most of the machine learning models are black box models. However, in practical applications, such as in many medical and health fields, it is very necessary to clearly understand the internal composition, combination or interaction of the model, study the system and predict the system behavior. Therefore, interpretable machine learning models have attracted more and more attention, especially when predicting based on models, the driving factors leading to prediction behavior are deeply studied. This paper proposes an interpretable machine learning model based on comparative learning and NARMAX. Because the input-output relationship of the model and the interaction relationship between input variables are clear, the model can not only be used for prediction, but also explain the relevant 'reasons' of prediction behavior. The novel coronavirus pneumonia epidemic data and influenza epidemic data were used to compare the model proposed in this paper. The experimental results show that the model is effective and reliable, and establish a dynamic model for the two diseases' spreads, and analyze the relationship between disease transmission factors. © 2022 IEEE.

LISA : Enhance the explainability of medical images unifying current XAI techniques

This work proposed a unified approach to increase the explainability of the predictions made by Convolution Neural Networks (CNNs) on medical images using currently available Explainable Artificial Intelligent (XAI) techniques. This method in-cooperates multiple techniques such as LISA aka Local Interpretable Model Agnostic Explanations (LIME), integrated gradients, Anchors and Shapley Additive Explanations (SHAP) which is Shapley values-based approach to provide explanations for the predictions provided by Blackbox models. This unified method increases the confidence in the black-box model's decision to be employed in crucial applications under the supervision of human specialists. In this work, a Chest X-ray (CXR) classification model for identifying Covid-19 patients is trained using transfer learning to illustrate the applicability of XAI techniques and the unified method (LISA) to explain model predictions. To derive predictions, an image-net based Inception V2 model is utilized as the transfer learning model. © 2022 IEEE.

Outcome Prediction in Critically-Ill Patients with Venous Thromboembolism and/or Cancer Using Machine Learning Algorithms: External Validation and Comparison with Scoring Systems.

Intensive care unit (ICU) patients with venous thromboembolism (VTE) and/or cancer suffer from high mortality rates. Mortality prediction in the ICU has been a major medical challenge for which several scoring systems exist but lack in specificity. This study focuses on two target groups, namely patients with thrombosis or cancer. The main goal is to develop and validate interpretable machine learning (ML) models to predict early and late mortality, while exploiting all available data stored in the medical record. To this end, retrospective data from two freely accessible databases, MIMIC-III and eICU, were used. Well-established ML algorithms were implemented utilizing automated and purposely built ML frameworks for addressing class imbalance. Prediction of early mortality showed excellent performance in both disease categories, in terms of the area under the receiver operating characteristic curve (AUC-ROC): VTE-MIMIC-III 0.93, eICU 0.87, cancer-MIMIC-III 0.94. On the other hand, late mortality prediction showed lower performance, i.e., AUC-ROC: VTE 0.82, cancer 0.74-0.88. The predictive model of early mortality developed from 1651 VTE patients (MIMIC-III) ended up with a signature of 35 features and was externally validated in 2659 patients from the eICU dataset. Our model outperformed traditional scoring systems in predicting early as well as late mortality. Novel biomarkers, such as red cell distribution width, were identified.

Exchange rates forecasting and trend analysis after the COVID-19 outbreak: new evidence from interpretable machine learning

We investigate the predictability of 12 exchange rates with machine learning, Deep Learning and interpretable machine learning (IML) models, based on a daily dataset from December 2019 to August 2021. We find that the appreciation and depreciation of exchange rates can be partly captured by Light Gradient Boosting Machine (LightGBM) and Long Short-Term Memory, especially for the developed currencies. Inconsistent with general perception, the LightGBM model performs the best in exchange rates forecasting since its short-term information extracting mode and great robustness on small datasets. Furthermore, by employing a representative global IML method, the Accumulated Local Effect algorithm, we find that the 1 similar to 3 lags of exchange rates provide more useful information for forecasting, which can help investors improve their models' predictive ability.